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0 ABSTRACT 



Th€? author believes her ideas on evaluation reporting 
are old ideas in various : fields including communication thteory, 

^advertising, social science, and learning theory. The human factor in 
reporting evaluation must be considered.. Those being evaluated often 
Jjpel threatened by the evaluation. Evaluators need to accept the 
beh^rors of evaluation subjects. They jnust be patient, persistent, 

*nd persuasive. Evaluators must deal in terms of group or social 

* behaviors, as well as individual behaviors. The evaluator should be 
an* impartial observer whp considers the program, ajid Research content. 
Guidelines for the evaluation report include form, brevity, technical 
language, and- type of ^presentation. The evaluator should realize that* 
utilization of the report will ^reqki re tinje. He may need to .regularly 

* recapitulate, repeat, and reinterpret his report. The pamper "contains 
quotations from Bartle|t's Familiar Quotations as old masters' 
contemporary applications/ to evaluation reporting.. (DWH) * 
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Foundations ,of fteportir\g1c 
Or ). 
Harriett's Guide- to Evaluation Communication 



" Freda M. Holley . 
Austin Independent School>i)istrict 



As I found myself trying to write this paper,- I realized I had arrived 

at a most unenviable spot. I ha.ve mostly told the world what I know about 4 

« - * • 

evaluation reporting (Lee and Holley 1978, rfolley 1979, Holley, Haskin, Mat- 

ter, Gilchrist, Baenen, et al. 1979, and Holley 1981). Chewing on this di- 



lemma, I considered my options and remembered!^ writer's traditional trick. 

***** • v . 

When the well is dry an* all else fails,* find some new way to say what has 
previously been recorded. As I ^considered 'it Ills *for awhile,* it suddenly oc- 
curred to me that- the things* I have said abdu£ evaluation reporting are n6t 
really new. They are olcf ideas in various^ fields— qpmmuni%ation theory, ad- 
vertising, social science, and learning 'theory. Then, it came tonne that my 
first encqunter with most of the ideas t;hat had proven so useful to me in 



evaluation communication were actually even ol,der. % Now, why was? that?- Why^ 
of course, it-was only because that first encounter had- been in my early 
days, of literary analysis. ,From that thought J went on to do some research. 
Now rgiv^a you— from just the first- hundred pages or so of Bartlett's Quo- - 
tations — some contemporary application of the old masters to evaluation re-. ' 
porting* ' They seem to. me to-be the very foundations of reporting that I 
felt the Wed to express. Of course, it also, lays the groundwork fo*-my next 



paper which miy be "Renaissance foundations/ f ©revaluation Reporting"-'or some 



such title. 



Human FactorVin Reporting 
* \ - 

* % \ * .* 

In reporting evaluation inf ormation,\we must understand the nature' o£ man 

\ * 

a nd th^yery human' concerns of those wtfose Wk we are involve^ in evaluating.'. 

Otherwise, we are unable to" understand our aukence, the first essential: 

' \ \ *° ' 

EV*luators are often surprised that those bWg evaluated cannot stand 

ispassionately back and view the objective evidence on' their efforts Anyone 

/ 

who is involved in a project with. 
s 

evaluation, however, has surely put 

* t 
his heart ^gjid hi^ energy-'fnto tjiat 

enterprise and insofar as evalaar* 

^pion threatens that investment ^ the 

reaction of the- participant is 

natural human behavior. * * ^ « 

/Evaluators also tend to be 

surprised that when *the report i's^ 



When neither their property 
nor their honor is touched, 
the majority of men live 
content* 

« * Ma&hiavelli 



-xeady^se^edul-ing^-heariTig^^is-^io^ 



always easy. The objects of evalua- 
tion are- all too aware that the 
chance of bad news is somewhat 
higher in most; instances than the* , 
probability of good news. Post- 
ponement is the anticipated! response. 



I would far. rather be ignorant 
than knowledgeable vf evil's. 
; * ^ Aeschylus^ 



From the notion that the audience is unwilling also flows the idea that, 
negative evaluation is .not likely to convince the subjects. ■ . • 



Bodily exeraise, when compulsory, 
does no-harm to the body; but 
knowledge which is' acquired under' 
compulsion obtains no hold on -the 
mind. ■ 

„• * Plato 



III great ehtmg^s are irk- 
apm£ to the human mind, 
especially those which are 
attended with great dangers 
and uncertain effects. ' - 
, % " John Adams 

^ The Response to oui^ request is 

a .tried and true strategy'- de3|ay! 
Perhaps the, next report will .change^ 



tnW 



Inevitably, 



i • 



,'what we are asking 
of our evaluatees is that' they make 
c&angesf in their behavior, but in 
this we ask the^greatest; of all. com- 
mitments . ' * ' 



he preserve 
i 



By delaying he ^preserved, 
the state. 

Quintus Ennius 



the* charge. 



If 



l am sometimes asked fif persuas ion 'is , an ethical^ methodology fox .evaluation 



communicators. "There are a, string, of truths about human nature- that tell me< 

* \ — \ * * * 

that the evaluator 'who dpes\not use persuasion is probatily one who fails to cL- 



municate at all. 



Nothing is so* firmly believed 
as what we least know. • \ ' 

r * \ 

% ^ Montatgne 



^Nothing is easier than self- * 
deceit. lor what &deh man 
wishes, that he- also believes 
tQ be true. 

» 'Demosthenes * , 



There are many times in reporting that wh;at we report* runs counter to 
appearances. The, child in' the experimental drama program who appears to be 
interested and learning turns out to make no gain in language skills. The 
•teacher finds it difficult to accept our test scores because 'they fly in the 
vat ions . " 



face of his ob S6 rvc 



Men trust their ^ ears less 
than their eyds\ 

Herodotus 



. 'How does the evaluator respond 
* * t h , 

to these natural human behaviors?, 
t It is important, first, to accept 
th ? es£ behaviors' "and £o be willing 
%o tfeal Vithr individuals in their 
infinite varieties,, to invest in 
persuasion, to persist,' and to be 
patient/ We must. also Cry to build 
-into -T>uf— efaluatiops"nc?fe only^ * * 
judgments on what lj£ a9 a *but goo/i 



options for wh£t can be, 



4 



Political and 



Aadbrdin^as the man is, 
so must yohjrumort him. 

iKfenoe - 



^ Jiow dreadful knowledge of 
the -trufh can be 
-When thSfre's no' help in 
truth! 

' * . Sophocles 



f 



Man is by nature a political 
animal. I f - , * - . 

*' AzistQt,le 



Social^Factors * 

(The evaj.uatoj: must deal not .only 
with Individuals in terms of human 
• behavior^, but alscf in, terms of group^ 
r of social behaviors/ * / 



• Sometimes the best" person to 

i 

get action on evaluation findings 
is not the "general, 11 but rather 
some other key person. The good 
evaluation communicator figures 
out who will be • the best recip- 
ient to stimulate action as well 
as the* proper pei^on in terms of 
the .organization chart, • „ 



'(Of his ^ sort) / 
The boy* is the most powerful 
of all the Hellenes i for the 
Hellenes are commanded by the 
Athenians, the Athenians by 
myself, rmfself by the boy's 
mother, and the mother by "her 
boy. 

I Themistocles 



^The difference is slight, 
to the influence of an , 
author, whether he is read 
by five hundred readers; r 
or by five hundred thousand; 
if he can select the five 
hundred, he reaches the five 
hundred* thousand. 

Henry Brooks Adtims < 



Mor^)ver/the number of people 
who receive a report may not be 
nearly so important as that' those 
who matter ^e'ceive^ it* * ; 



The Evaluator 



The lot of the evaluator is 
not a> good one. 1 



Nobody Tikes the man who 
brings baa news. s ' 

Sophocles 



• . The evaluator may report good news year after year and build up a con- 
tingent of friends , but the^number will fade rapidly wi<h but one -bad message', 



v 

. t 



^^vert/h advantage in^the past 
is judged in the light Vf 
S the final issue. 

'* Demosthenes 



\ 



. 5. 



The'evaluator must also be 

I 

careful about undue friendliness 
with staff since their reaction 
to negative findings-will be^a 
sense of^ betrayal* 



How dreadful it is when the 
right judge judges wrong! - 
Sophocles 



In short the ^valuator must « e a kind of historian Vho is an exemplar o 
humanity. • x 



The 9 first law for the historian is that he shall 
never dare utter an untruth. The second is that 
he shall suppress nothing that is true. Moreover, 
there shall be no suspicion of partiality \in his 



writing 3 oor of malice. 



Cicero 



Context of the Evaluation 



It is circumstance .and 
proper timing tlnht give 
^ action its ' character 
and make it either* good 
or bad. 

Agesilaus 



m 



The research context must also 
be* considered. We must interpret 
the isolated finding in t^rms of 
our .own previous work. and that 
of others nationally. * t s 



: 7 1 • 

The evaluator must be ever 
mindful that he heed the context 
of*a # program for it makes all the 
difference in how a result .is 
interpreted., • c * 



One. swallow does not make 
a summer. , > 

* Aristotle < v 



The Report Itself 



The literature is particularly full' of guidelines in reporting, perhaps 
because, *c has always been a function of the'writer to- tell the society about 
itself. Writers early begaff to distill reporting guidelines. 

^ Form is the first consideration/ And of 'that form the most. important is 
the beginning. t \ ' Xl. 

\ - . • A . • - 

J whole -i's th^p which has a, \ pie beginning is the 'most 

.beginning, mzddle, and end. \ important part of the whole. 

Aristotle * * Plato 



It is quality rather than 
quantity that matters. 

Seneca 



. The second guideline is to keep 
it brief ... 



It is this simplicity that 
makes* the uneducated more 
effective than the educated 
when addressing" popular 
audiences. 

• 4 * Aristotle 



.and simple, 



Yet we must keep in mind that 
there must be enough jargon that we 
are recognized for our skills. 

/ 



High thoughts must have 
'high language. 

Aristophanes 



The same type-oT evaluation presentation cannot be used repeatedly. In 
p-articulpt, final reports tq Boards must be 'varied infinitely to get V and hold 
their interests. ^ * 



It isfnot possible to step- 
twice in s the stone river. 

Heraclitus 



> One picture is worth more 
them ten thousand words. 

Chinese proverb 



* Illustrations as always are 
recognized. as' valuable. , * 



We' are rightfully cautioned about 
puttdng irt^too many ifs ? ands, and 
buts,. To do so, assures that our 
audience will be* lost. 



And 'while I at ^length, debate 

and 'beat the bush. 
There shall step in other men- 

and catch the birds. 

John Heywood 



Evaluation* Impact { 



Antiphores said merrily 
that in a certain city the - 
cold was so intense that , » 
wovds were congealed as 
soon as spoken > but that 
after some time they thawed 
and became audible; so that 
the words spoken in winper 
wer^e articulated next summer. 

* Plutarch 



\However, the evaluator must 
*also remember that an institutional 
memory of the report cannot be de- 
pended upon. . People come and people 
go; therefore, he mufet be willing to 
regularly recapitulate, repeat, and 
reinterpret. 



A most important lesson for 
the evaluator is that he mtfst not 
expect utilization to follow quickly 
ppon the evaluation 're'port. A ge"s- 
tation period seems to be required. 
•I know communication has succeeded '* 
when some one tells me Conclusively 
"Yes, Vesearch says . (whatever my ; 
report suggested) . 11 



Time is a sort of river of 
-passing -events j and strong 
'i£ its current; no sooner \ ; 
v$ a thing^ brought to sig}(t 
than it is swept by arid another 
takes its place s andjt^s too 
will bf swept-away . ^Jp 

Marcus Aurelius 



Thus w$ see how little is new and how, much is old. Evfen ipon this, " my 
speech, the ancients have the" final eval^tion word. 
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